Especificación, implementación y evaluación de soluciones de sincronización multimedia híbrida (broadcast/broadband) e inter-destinatario para posibilitar nuevas experiencias televisivas enriquecidas, personalizadas, inmersivas y compartidas.

[ES] Actualmente, existe una gran variedad de tecnologías de distribución de contenidos multimedia, de dispositivos de consumo, así como de tipos de contenidos. En cuanto a tecnologías de distribución, dichos contenidos se pueden enviar bien a través de redes broadcast, como las redes DVB, o bien a través de redes broadband, como las redes IP (por ejemplo, a través de Internet). La coordinación y convergencia entre los dos tipos de tecnologías para distribuir contenidos relacionados ofrece un gran potencial a los proveedores de contenidos, así como grandes beneficios a los consumidores (una prueba de ello es el estándar Hybrid Broadcast Broadband TV o HbbTV). Sin embargo, la recepción de contenidos relacionados procedentes de diferentes redes híbridas (broadcast/broadband) conlleva una variabilidad de retardos significativa, por lo que se deben superar una serie de retos importantes, como, por ejemplo, la necesidad de mecanismos que garanticen un consumo sincronizado de dichos contenidos, bien en un mismo dispositivo o bien en distintos dispositivos (locales o remotos). Se han especificado, implementado y evaluado soluciones de sincronización de los procesos de reproducción de contenidos híbridos (prevenientes de redes broadcast y/o broadband) tanto en entornos multidispositivo, entre dispositivos locales (Inter-Device Synchronization o IDES), como en entornos multiusuario, entre destinatarios distribuidos en red (Inter-Destination Media Synchronization o IDMS), incluyendo la sincronización de efectos multisensoriales. Se ha diseñado e implementado una plataforma extremo-a-extremo para la generación, distribución (adaptativa) y consumo de contenidos híbridos relacionados, tanto en un mismo dispositivo como en múltiples dispositivos locales (por ejemplo, escenario multipantalla) o remotos (por ejemplo, TV Social). Se han generado y preparado contenidos multimedia tradicionales (2D) y omnidireccionales (360), enriquecidos con efectos multisensoriales que mejoran el grado de realismo y la inmersividad de los usuarios. La plataforma es compatible con el estándar HbbTV y, además, incluye soluciones eficientes para aspectos clave que no están especificados en dicho estándar, pero que son necesarios para la implementación satisfactoria de servicios de TV híbridos y multidispositivo en la misma, como, por ejemplo: la necesidad de un buffer para el contenido broadcast (existente y opcional hasta la especificación HbbTV 2.0.2); mecanismos de señalización, asociación y descripción de contenido disponible y relacionado con el contenido principal; mecanismos de coordinación e interacción entre los dispositivos de consumo; o soluciones de sincronización para alinear en el tiempo el consumo de contenidos de forma satisfactoria. Los resultados obtenidos en la evaluación realizada muestran que el nivel de sincronización adquirido entre los procesos de reproducción de los diversos tipos de contenido disponibles a través de distintas tecnologías de transmisión alcanza unos valores suficientes para proporcionar al usuario un consumo con un nivel de asincronías imperceptible. Dicha precisión alcanzada ha resultado en una QoE para el consumidor muy satisfactoria, ofreciéndole al mismo un completo ecosistema de consumo de contenidos que incluye tanto contenido multimedia tradicional, como contenido omnidireccional y mulsemedia.[CA] Actualment, hi ha una gran varietat de tecnologies de distribució de contingut multimèdia, dispositius de consum, així com tipus de contingut. Pel que fa a les tecnologies de distribució, aquest contingut es pot lliurar a través de xarxes de difusió, com ara xarxes DVB, o a través de xarxes de banda ampla, com les xarxes IP (per exemple, a través d'Internet). La coordinació i convergència entre els dos tipus de tecnologies per distribuir continguts relacionats ofereix un gran potencial als proveïdors de continguts, així com grans beneficis per als consumidors (una prova d'això és l'estàndard Hybrid Broadcast Broadband TV o HbbTV). Tanmateix, la recepció de continguts relacionats des de diferents xarxes híbrides (emissió/banda ampla) comporta una important variabilitat de retard, per la qual cosa s'han de superar una sèrie de reptes importants, com la necessitat de mecanismes que garanteixin el consum sincronitzat d'aquests continguts, ja siga en el mateix dispositiu. o en diferents dispositius (locals o remots). S'han especificat, implementat i evaluat solucions de sincronització per a processos de reproducció de continguts híbrids (xarxes de broadcast i/o de banda ampla) tant en entorns multidispositiu, entre dispositius locals (Inter-Device Synchronization o IDES), com en entorns IDMS (Inter-Destination Media Synchronization o IDMS), incloent la sincronització d'efectes multisensorials. S'ha dissenyat i implementat una plataforma d'extrem a extrem per a la generació, distribució (adaptativa) i consum de contingut híbrid relacionat, tant en un sol dispositiu com en múltiples locals (p. ex., escenari multipantalla) o remots (p. ex., Social TV). dispositius. S'han generat i preparat contingut multimèdia tradicional (2D) i omnidireccional (360), enriquit amb efectes multisensorials que milloren el grau de realisme i immersivitat dels usuaris. La plataforma és compatible amb l'estàndard HbbTV i, a més, inclou solucions eficients per a aspectes clau que no s'especifiquen en aquest estàndard, però que són necessaris per a la implantació amb èxit de serveis de televisió híbrids i multidispositiu en el mateix, com ara: la necessitat per a un buffer per a continguts de difusió (existent i opcional fins a HbbTV 2. 0.2); mecanismes de senyalització, associació i descripció dels continguts disponibles i relacionats amb el contingut principal; mecanismes de coordinació i interacció entre dispositius de consum; o solucions de sincronització per alinear en el temps el consum de continguts de manera satisfactòria. Els resultats obtinguts en l'avaluació realitzada mostren que el nivell de sincronització adquirit entre els processos de reproducció dels diferents tipus de continguts disponibles a través de diferents tecnologies de transmissió assoleix valors suficients per proporcionar a l'usuari un consum amb un nivell d'asincronies imperceptibles. La precisió aconseguida ha donat com a resultat una QoE molt satisfactòria per al consumidor, oferint-li un ecosistema complet de consum de continguts que inclou tant contingut multimèdia tradicional com contingut omnidireccional i mulsemedia.[EN] Currently, there is a wide variety of multimedia content distribution technologies, consumer devices, as well as types of content. In terms of distribution technologies, such content can be delivered either over broadcast networks, such as DVB networks, or over broadband networks, such as IP networks (e.g. over the Internet). The coordination and convergence between the two types of technologies to distribute related content offers great potential to content providers, as well as great benefits to consumers (a proof of this is the Hybrid Broadcast Broadband TV or HbbTV standard). However, the reception of related content from different hybrid networks (broadcast/broadband) entails significant delay variability, so a number of important challenges must be overcome, such as the need for mechanisms to ensure synchronized consumption of such content, either on the same device or on different devices (local or remote). We have specified, implemented and evaluated synchronization solutions for hybrid content playback processes (broadcast and/or broadband networks) both in multi-device environments, between local devices (Inter-Device Synchronization or IDES), and in multi-user environments, between distributed network recipients (Inter-Destination Media Synchronization or IDMS), including the synchronization of multi-sensory effects. An end-to-end platform has been designed and implemented for the generation, distribution (adaptive) and consumption of related hybrid content, both on a single device and on multiple local (e.g., multiscreen scenario) or remote (e.g., Social TV) devices. Traditional (2D) and omnidirectional (360) multimedia content has been generated and prepared, enriched with multisensory effects that enhance the degree of realism and immersiveness for users. The platform is compatible with the HbbTV standard and, in addition, includes efficient solutions for key aspects that are not specified in that standard, but are necessary for the successful implementation of hybrid and multi-device TV services on it, such as: the need for a buffer for broadcast content (existing and optional up to the HbbTV 2. 0.2); mechanisms for signaling, association and description of content available and related to the main content; coordination and interaction mechanisms between consumption devices; or synchronization solutions to align in time the consumption of content in a satisfactory way. The results obtained in the evaluation carried out show that the level of synchronization acquired between the reproduction processes of the different types of content available through different transmission technologies reaches sufficient values to provide the user with a consumption with an imperceptible level of asynchronies. The accuracy achieved has resulted in a very satisfactory QoE for the consumer, offering him a complete content consumption ecosystem that includes traditional multimedia content as well as omnidirectional and mulsemedia content.Marfil Reguero, D. (2022). Especificación, implementación y evaluación de soluciones de sincronización multimedia híbrida (broadcast/broadband) e inter-destinatario para posibilitar nuevas experiencias televisivas enriquecidas, personalizadas, inmersivas y compartidas [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/18574

Diseño e implementación de un circuito electrónico inteligente para la emisión de sonido para control de plagas

Marfil Reguero, D. (2011). Diseño e implementación de un circuito electrónico inteligente para la emisión de sonido para control de plagas. http://hdl.handle.net/10251/11293.Archivo delegad

Hybrid Broadcast/Broadband TV Services and Media Synchronization. Demands, Preferences and Expectations of Spanish Consumers

© 2018 IEEE. Personal use of this material is permitted. Permissíon from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertisíng or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.[EN] The combination of broadcast and broadband ( hybrid) technologies for delivering TV related media contents is already a reality. It has been motivated by the large amount and diversity of media contents, together with the ubiquity and multiple connectivity capabilities of modern consumption devices. The use of connected TVs and companion devices (e.g., tablets, smartphones etc.) is gaining momentum. It enables personalized and enriched TV media experiences, by also exploiting social communication opportunities. Likewise, the media consumption paradigm is worldwide evolving from passive and isolated consumer experiences toward interactive and group shared experiences between remote consumers. Nevertheless, despite the specification of standards, such as hybrid broadcast broadband TV, and the efforts from operators and content providers in the last years, the adoption of hybrid TV media services in Europe is still not as high as expected. This paper presents the concept and some examples of hybrid TV media services, emphasizing the importance of including a combination of media synchronization solutions, known as hybrid sync, to guarantee a satisfactory level of quality of experience. Additionally, it includes the summary and discussion of the results of a research study focused on more than 1000 Spanish users' habits, preferences, and expectations regarding four representative hybrid TV media services. Many valuable insights and conclusions have been derived. For instance, the current low market adoption of hybrid TV media services, despite their advantages and the high interest of consumers, and that key technological challenges still need to be overcome. The obtained results and impressions foresee the impact (or potential) of such services in the upcoming TV related media consumption landscape. Therefore, devising proper standard-compliant technological solutions (paying special attention to hybrid sync) and equipment should be continued producing appropriate contents, deploying proper hybrid TV media services and applications. As well, it should be convenient to undertake marketing and commercial efforts to boost their deployment. The contributions of this paper can be very valuable to the interested agents to be aware of the remaining challenges, envisage the opportunities, and drive their efforts to maximize the market adoption of such services.This work was supported in part by the Fondo Europeo de Desarrollo Regional, in part by the Spanish Ministry of Economy and Competitiveness under Its R&D&I Support Program under Project TEC2013-45492-R.Boronat, F.; Montagud, M.; Marfil-Reguero, D.; Luzón, C. (2018). Hybrid Broadcast/Broadband TV Services and Media Synchronization. Demands, Preferences and Expectations of Spanish Consumers. IEEE Transactions on Broadcasting. 64(1):52-69. https://doi.org/10.1109/TBC.2017.2737819S526964

Enhancing the broadcasted TV consumption experience with broadband omnidirectional video content

[EN] The current wide range of heterogeneous consumption devices and delivery technologies, offers the opportunity to provide related contents in order to enhance and enrich the TV consumption experience. This paper describes a solution to handle the delivery and synchronous consumption of traditional broadcast TV content and related broadband omnidirectional video content. The solution is intended to support both hybrid (broadcast/broadband) delivery technologies and has been designed to be compatible with the Hybrid Broadcast Broadband TV (HbbTV) standard. In particular, some specifications of HbbTV, such as the use of global timestamps or discovery mechanisms, have been adopted. However, additional functionalities have been designed to achieve accurate synchronization and to support the playout of omnidirectional video content in current consumption devices. In order to prove that commercial hybrid environments could be immediately enhanced with this type of content, the proposed solution has been included in a testbed, and objectively and subjectively evaluated. Regarding the omnidirectional video content, the two most common types of projections are supported: equirectangular and cube map. The results of the objective assessment show that the playout of broadband delivered omnidirectional video content in companion devices can be accurately synchronized with the playout on TV of traditional broadcast 2D content. The results of the subjective assessment show the high interest of users in this type of new enriched and immersive experience that contributes to enhance their Quality of Experience (QoE) and engagement.This work was supported by the Generalitat Valenciana, Investigacion Competitiva Proyectos, through the Research and Development Program Grants for Research Groups to be Consolidated, under Grant AICO/2017/059 and Grant AICO/2017Marfil-Reguero, D.; Boronat, F.; López, J.; Vidal Meló, A. (2019). Enhancing the broadcasted TV consumption experience with broadband omnidirectional video content. IEEE Access. 7:171864-171883. https://doi.org/10.1109/ACCESS.2019.2956084S171864171883

IDMS solution for hybrid broadcast broadband delivery within the context of HbbTV standard

"© 2019 IEEE. Personal use of this material is permitted. Permissíon from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertisíng or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works."[EN] Inter-destination media synchronization (IDMS) is a key requirement to enable successful networked shared media experiences between remote users. This paper presents an adaptive, accurate and standard-compliant IDMS solution for hybrid broadcast and broadband delivery. Apart from providing multi- and cross-technology support, the presented IDMS solution is able to accomplish synchronization when different formats/versions of the same, or even related, contents are being played out in a shared session. It is also able to independently manage the playout processes of different groups of users. The IDMS solution has been integrated within an end-to-end platform, which is compatible with the hybrid broadcast broadband TV standard. It has been applied to digital video broadcasting-terrestrial technology and tested for a Social TV scenario, by also including an ad-hoc chat tool as an interaction channel. The results of the conducted (objective and subjective) evaluations prove the statisfactory behavior and performance of the IDMS solution and platform as well as in terms of the perceived quality of experience.This work was supported by Generalitat Valenciana, Investigacion competitiva proyectos, through the Research and Development Program "Grants for research groups to be consolidated, AICO/2017," under Grant AICO/2017/059.Marfil-Reguero, D.; Boronat, F.; Montagud, M.; Sapena Piera, A. (2019). IDMS solution for hybrid broadcast broadband delivery within the context of HbbTV standard. IEEE Transactions on Broadcasting. 65(4):645-663. https://doi.org/10.1109/TBC.2018.2878285S64566365

HbbTV-compliant Platform for Hybrid Media Delivery and Synchronization on Single- and Multi-Device Scenarios

[EN] The combination of broadcast and broadband (hybrid) technologies for delivering TV related media contents can bring fascinating opportunities. It is motivated by the large amount and diversity of media contents, together with the ubiquity and multiple connectivity capabilities of modern consumption devices. This paper presents an end-to-end platform for the preparation, delivery, and synchronized consumption of related hybrid (broadcast/broadband) media contents on a single device and/or on multiple close-by devices (i.e., a multi-device scenario). It is compatible with the latest version of the Hybrid Broadcast Broadband TV (HbbTV) standard (version 2.0.1). Additionally, it provides adaptive and efficient solutions for key issues not specified in that standard, but that are necessary to successfully deploy hybrid and multidevice media services. Moreover, apart from MPEG-DASH and HTML5, which are the broadband technologies adopted by HbbTV, the platform also provides support for using HTTP Live Streaming and Real-time Transport Protocol and its companion RTP Control Protocol broadband technologies. The presented platform can provide support for many hybrid media services. In this paper, in order to evaluate it, the use case of multi-device and multi-view TV service has been selected. The results of both objective and subjective assessments have been very satisfactory, in terms of performance (stability, smooth playout, delays, and sync accuracy), usability of the platform, usefulness of its functionalities, and the awaken interest in these kinds of platforms.This work was supported in part by the "Fondo Europeo de Desarrollo Regional" and in part by the Spanish Ministry of Economy and Competitiveness through R&D&I Support Program under Grant TEC2013-45492-R.Boronat, F.; Marfil-Reguero, D.; Montagud, M.; Pastor Castillo, FJ. (2017). HbbTV-compliant Platform for Hybrid Media Delivery and Synchronization on Single- and Multi-Device Scenarios. IEEE Transactions on Broadcasting. 1-26. https://doi.org/10.1109/TBC.2017.2781124S12

Synchronization Mechanisms for Multi-User and Multi-Device Hybrid Broadcast and Broadband Distributed Scenarios

(c) 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.[EN] Traditionally, co-located TV content consumption has been a social habit (e.g., family members in the living room watching TV). It cannot be always possible to enjoy these shared experiences in the current global society, in which relatives or friends might live apart. In this context, the emergence of new technologies together with the advent of social media and conferencing services brings the possibility of recreating them when users are geographically distributed. When remote users are involved in a networked shared TV consumption experience (Social TV), inter-destination media synchronization (IDMS) is a key requirement to provide them with a satisfactory experience. Moreover, enriching the broadcasted TV content with alternative (or complementary) broadband content is gaining momentum. When several co-located consumption devices are involved in the TV viewing experience, inter-device synchronization (IDES) mechanisms are also needed to allow successful multi-screen experiences. This paper presents a combined synchronization mechanism (including both IDMS and IDES solutions) for distributed scenarios involving remote users and hybrid (broadcast and broadband) contents, to be consumed in one or several devices. The mechanism provides multi- and cross-technology support and achieves accurate synchronization levels even when different versions or formats of the media contents are being played out. It has been integrated into a hybrid broadcast broadband TV standard-based platform, and the achieved synchronization accuracy and the performance of the solution for the Social TV use case have been evaluated, obtaining satisfactory and promising results.This work supported by the Generalitat Valenciana, Investigacion Competitiva Proyectos, through the R&D Program "Grants for research groups to be consolidated, AICO/2017,'' under Project AICO/2017/059.Marfil-Reguero, D.; Boronat, F.; Sapena Piera, A.; Vidal Meló, A. (2019). Synchronization Mechanisms for Multi-User and Multi-Device Hybrid Broadcast and Broadband Distributed Scenarios. IEEE Access. 7:605-624. https://doi.org/10.1109/ACCESS.2018.2885580S605624

Implementación de una plataforma de consumo sincronizado de contenidos multimedia, híbridos (broadcast/broadband) en entornos mono y multi-dispositivo, basada en Gstreamer y compatible con el estándar HbbTV 2.0

The project includes the design, implementation and evaluation of an end-to-end hybrid consumption synchronized multimedia content (broadcast / broadband) related, for mono and multi-device platform environments. This platform will be compatible with HbbTV 2.0 standard, and will be based on the GStreamer framework for Linux and Android based devices. The platform will include different modules for the preparation of multimedia content: timestamps insertions, DVB modulation, broadband transmission, reception, processing of multimedia content and synchronized playback. It will also include modules for device discovery, execution of HbbTV compatible applications and discovery of the available content, their properties and metadata, and technologies used for transmission. This platform should provide adaptive, effective and precise solutions for those unspecified issues or functionalities in the HbbTV 2.0 standard, although being necessary for successful hybrid media inter-device synchronization, i.e., ensuring satisfactory QoE levels. The platform will be assessed both objectively and subjectively for the use case of multi-view TV in which a main view is received in the main screen via broadcast and other complementary views either on the main TV or second screens, via broadband.El proyecto consiste en el diseño, implementación y evaluación de una plataforma extremo-a-extremo de consumo sincronizado de contenidos multimedia híbridos (broadcast/broadband) relacionados en entornos mono y multi-dispositivo. Dicha plataforma será compatible con el estándar HbbTV 2.0, y se basará en el uso del framework GStreamer, tanto en dispositivos con sistemas operativos Linux y Android. La plataforma incluirá diferentes módulos para la preparación del contenido multimedia, inserción de marcas temporales, modulación DVB, transmisión broadband, recepción, procesado de los contenidos multimedia y su reproducción sincronizada. Asimismo, también incluirá módulos para el descubrimiento de dispositivos, la ejecución de aplicaciones compatibles con HbbTV y el descubrimiento de los contenidos disponibles, sus propiedades y metadatos, y las tecnologías utilizadas para su transmisión. Esta plataforma deberá aportar soluciones adaptivas, efectivas y precisas para aquellos aspectos o funcionalidades no especificados en el estándar HbbTV 2.0, pero que son necesarios para conseguir la sincronización multimedia híbrida e inter-dispositivo de manera satisfactoria, es decir, garantizando niveles de QoE satisfactorios. La plataforma se evaluará tanto objetivamente como subjetivamente para el caso de uso de TV multi-vista o multi-cámara, en el que se recibe una vista principal en la pantalla principal vía broadcast y otras vistas complementarias, bien en la TV principal o en segundas pantallas, vía broadband.Marfil Reguero, D. (2016). Implementación de una plataforma de consumo sincronizado de contenidos multimedia, híbridos (broadcast/broadband) en entornos mono y multi-dispositivo, basada en Gstreamer y compatible con el estándar HbbTV 2.0. http://hdl.handle.net/10251/80479.TFG

Diseño de una aplicación para televisión conectada, incluyendo la recepción y visualización sincronizada de contenidos híbridos

In this work, an application for smart TV will be developped, including the reception and synchronized playout of hybrid content (obtained vía broadcast and broadband services) either in the same TV set top box or in the TV set and other associated devices.En el proyecto se diseñará una aplicación para TV conectada (smart TV) que incluya la recepción y la reproducción sincronizada de contenidos híbridos (vía broadcast y broadband) tanto en un mismo televisor como en el televisor y en diversos dispositivos relacionados.Marfil Reguero, D. (2015). Diseño de una aplicación para televisión conectada, incluyendo la recepción y visualización sincronizada de contenidos híbridos. Universitat Politècnica de València. http://hdl.handle.net/10251/54448TFG